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DATA-ON-DEMAND DIGITAL BROADCAST SYSTEM UTILIZING PREFETCH DATA 

TRANSMISSION 

5 CROSS-REFERENCE TO RELATED APPLICATIONS 

[1J The present application claims priority as a continuation in part to Khoi Hoang's co- 
pending application Decreased Idle Time And Constant Bandwidth Data-On-Demand 
Broadcast Delivery Matrices filed June 25, 2001, bearing application No. 09/892,017, 
which is a continuation-in-part application of Khoi Hoang's parent application entitled Systems 
]$k and Methods for Providing Video-On-Demand Services For Broadcasting Systems 
S" filed May 31, 2000, bearing application no. 09/584,832, which is incorporated herein by 
reference. The present application further claims priority to Khoi Nhu Hoang's co-pending 

O patent application entitled Universal Digital Broadcast System and Methods filed on 

o 

f£ April 24, 2001, bearing application no. 09/841,792, which is also incorporated herein by 
|5 reference. 

j A. BACKGROUND OF THE INVENTION 

O [2.] Video-on-demand (VOD) systems are one type of data-on-demand (DOD) system. 

In VOD systems, video data files are provided by a server or a network of servers to one or more 

20 clients on a demand basis. These systems will be well understood by those of skill in the art. 

[3.] In a conventional VOD architecture, a server or a network of servers communicates 
with clients in a standard hierarchical client-server model. For example, a client sends a request 
to a server for a data file (e.g., a video data file). In response to the client request, the server 
sends the requested file to the client. In the standard client-server model, a client's request for a 

25 data file can be fulfilled by one or more servers. The client may have the capability to store any 
received data file locally in non- volatile memory for later use. The standard client-server model 
requires a two-way communications infrastructure. Currently, two-way communications 
requires building new infrastructure because existing cables can only provide one-way 
communications. Examples of two-way communications infrastructure are hybrid fiber optics 
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coaxial cables (HFC) or all fiber infrastructure. Replacing existing cables is very costly and the 

resulting services may not be affordable to most users. 

[4.] In addition, the standard client-server model has many limitations when a service 

provider (e.g., a cable company) attempts to provide VOD services to a large number of clients. 
5 One limitation of the standard client-server model is that the service provider has to implement a 

mechanism to continuously listen and fulfill every request from each client within the network; 

thus, the number of clients who can receive service is dependent on the capacity of such a 

mechanism. One mechanism uses massively-parallel computers having large and fast disk arrays 

as local servers. However, even the fastest existing local server can only deliver video data 
10 streams to about 1000 to 2000 clients at one time. Thus, in order to service more clients, the 

number of local servers must increase. Increasing local servers requires more upper level servers 
O to maintain control of the local servers. 

S [5.] Another limitation of conventional systems is that a receiving set top box (STB) must 

f download at least a portion of a selected VOD service before it can play the service. The delay 
S required to download sufficient data in order to play a selected VOD can be significant even with 
J* very high download speeds. 

H [6.] Another limitation of the standard client-server model is that each client requires its 

'U own bandwidth. Thus, the total required bandwidth is directly proportional to the number of 
£ subscribing clients. Cache memory within local servers has been used to improve bandwidth 
16 limitation but using cache memory does not solve the problem because cache memory is also 
limited. 

[7.] Presently, in order to make video-on-demand services more affordable for clients, 
existing service providers are increasing the ratio of clients per local server above the local 
server's capabilities. Typically, a local server, which is capable of providing service to 1000 
25 clients, is actually committed to service 10,000 clients. This technique may work if most of the 
subscribing clients do not order videos at the same time. However, this technique is set up for 
failure because most clients are likely to want to view videos at the same time (i.e., evenings and 
weekends), thus, causing the local server to become overloaded. 
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[8.] Thus, it is desirable to provide a system that is capable of providing on-demand 
services without significant delay to a large number of clients over virtually any transmission 
medium without replacing existing infrastructure. 

SUMMARY OF THE INVENTION 

5 [9.] The present invention teaches systems and methods for providing data-on-demand 
(DOD) services with reduced access time over existing DOD systems. The present invention 
also teaches systems and methods for providing DOD services over a decreased bandwidth. 

[10.] In an exemplary embodiment, at a server side, a method for sending data to a client 
to provide data-on-demand services comprising the steps of: providing a decreased idle time 

10 linear sequence of data blocks containing data including a selected DOD service; removing a 

o m ost frequently occurring data block from said decreased idle time sequence of data blocks; 

m placing said removed most frequently occurring data block in a prefetch data stream such that 

£ said prefetch data stream includes prefetch data blocks corresponding to said selected DOD 

6 service; transmitting said prefetch data stream via said transmission medium; and transmitting 
15 said remaining decreased idle time sequence of data blocks via said transmission medium such 
S that a receiving device may combine said remaining decreased idle time sequence of data blocks 
P and said prefetch data blocks to create said selected DOD service, thereby decreasing the 
S bandwidth necessary to transmit said DOD service. The DOD broadcast server method may 
^ further comprise: removing a plurality of additional data blocks from said decreased idle time 
20 sequence of data blocks; placing at least one of said plurality of additional data blocks in said 

prefetch data stream such that said prefetch data stream includes said most frequently occurring 
data blocks and said additional data blocks corresponding to said selected DOD service; and 
transmitting said remaining decreased idle time sequence of data blocks via said transmission 
medium such that a receiving device may combine said remaining decreased idle time sequence 
25 of data blocks, and said prefetch data blocks to create said selected DOD service, thereby further 
decreasing the bandwidth necessary to transmit said DOD service. 

[11.] In an exemplary embodiment, at a client side, a method for processing data received 
from a server to provide data-on-demand services comprises the steps of: receiving a prefetch 
data stream containing prefetch data blocks corresponding to a selected DOD service; storing 
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said prefetch data blocks in a memory location; receiving a primary data stream containing 
primary data blocks corresponding to said selected DOD service; and processing said primary 
data blocks and said prefetch data bocks in order to enable a user to access said selected DOD 
service. The method may further include: receiving user input indicative of said selected DOD 
5 service; switching to a channel corresponding to said selected DOD service in response to said 
user input; and receiving said primary data stream from said channel corresponding to said 
selected DOD service. In one embodiment, the method for processing data received from a 
server is performed by a set-top box at the client side. 

[12.] A data-on-demand system comprises a first set of channel servers, a central 
10 controlling server for controlling the first set of channel servers, a first set of up-converters 
H coupled to the first set of channel servers, a combiner/amplifier coupled to the first set of up- 
p converters, and a combiner/amplifier adapted to transmit data via a transmission medium. In an 
g S exemplary embodiment, the data-on-demand system further comprises a channel monitoring 
Q module for monitoring the system, a switch matrix, a second set of channel servers, and a second 
j§ set of up-converters. The channel monitoring module is configured to report to the central 
!\ controlling server when system failure occurs. The central controlling server, in response to a 
O report from the channel monitoring module, instructs the switch matrix to replace a defective 
yQ channel server in the first set of channel servers with a channel server in the second set of 
rf channel servers and a defective up-converter in the first set of up-converters with an up-converter 
20 in the second set of up-converters. 

[13.] Another embodiment of the present invention teaches a universal STB capable of 
receiving and handling a plurality of digital services such as VOD and digital broadcast. This 
embodiment teaches a universal STB having a highly flexible architecture capable of 
sophisticated processing of received data. This architecture includes a databus, a first 
25 communication device suitable for coupling to a digital broadcast communications medium, a 
memory typically including persistent and transient memory bi-directionally coupled to the 
databus, a digital data decoder bi-directionally coupled to the databus, and a central processing 
unit (CPU) bi-directionally coupled to the databus. The CPU of this embodiment of the present 
invention implements a STB control process for controlling the memory, the digital decoder, and 
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the demodulator. The STB control process is operable to process digital data such as that 
received at the first communications device. The STB control process should be capable of 
receiving data blocks derived from a decreased idle time scheduling matrix as well as parallel 
streaming of such data blocks. 

[14.] In another embodiment, the complex STB architectures allow a data-block 
optimized pre-loading data stream to be broadcast and loaded into an idle STB. The pre-loading 
of specific data blocks into a STB allows bandwidth savings at critical times. The pre-loading 
data stream (or "pre-fetch") can be programmed to pre-deliver different data sequences at 
different times of the day based on VOD preferences. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[15.] FIG. 1A illustrates an exemplary DOD system in accordance with an 
embodiment of the invention. 

FIG. IB illustrates an exemplary DOD system in accordance with another 
embodiment of the invention. 

FIG. 2 illustrates an exemplary channel server in accordance with an embodiment 

of the invention. 

FIG. 3 illustrates an exemplary set-top box in accordance with an embodiment of 
the invention. 

FIG. 4 illustrates an exemplary process for generating a scheduling matrix in 
accordance with an embodiment of the invention. 

FIG. 5 graphically illustrates an example of a scheduling matrix of a six data 

block file. 

FIG. 6 graphically illustrates how the data blocks of the scheduling matrix in FIG. 5 are 
moved up until all idle time slots are filled. 

FIG. 7 graphically illustrates a new decreased idle time scheduling matrix. 

FIG. 8 depicts the addition of the decreased idle time embodiment. 
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FIG. 9 is a flow chart diagram illustrating how the decreased idle time embodiment is 
accomplished. 

FIG. 10 is a flow chart diagram illustrating a process for scheduling DOD data blocks for 
transmission on a primary data stream and a prefetch data stream in accordance with one 
5 embodiment of the present invention 

FIG. 1 1 is a flow chart diagram illustrating a process for scheduling DOD data blocks for 
transmission on a primary data stream and a prefetch data stream in accordance with an 
alternative embodiment of the present invention; and 

FIG. 12 is a flow chart diagram illustrating a set-top-box pre-loading process in 
l5 accordance with one embodiment of the present invention. 

£ DETAILED DESCRIPTION OF THE INVENTION 

S [16.] FIG. 1A illustrates an exemplary DOD system 100 in accordance with an 

embodiment of the invention. In this embodiment, the DOD system 1 00 provides data files, such 

b as video files, on demand. However, the DOD system 100 is not limited to providing video files 

£§ on demand but is also capable of providing other data files, for example, game files on demand. 

P The DOD system 100 includes a central controlling server 102, a central storage 103, a plurality 
of channel servers 104a-104n, a plurality of up-converters 106a-106n, and a combiner/amplifier 
108. The central controlling server 102 controls the channel servers 104. The central storage 
103 stores data files in digital format. In an exemplary embodiment, data files stored in the 

20 central storage 103 are accessible via a standard network interface (e.g., Ethernet connection) by 
any authorized computer, such as the central controller server 102, connected to the network. 
Each channel server 104 is assigned to a channel and is coupled to an up-converter 106. The 
channel servers 104 provide data files that are retrieved from the central storage 103 in 
accordance with instructions from the central controlling server 102. The output of each channel 

25 server 104 is a quadrature amplitude modulation (QAM) modulated intermediate frequency (IF) 
signal having a suitable frequency for the corresponding up-converter 106. The QAM- 
modulated IF signals are dependent upon adopted standards. The current adopted standard in the 
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United States is the data-over-cable-systems-interface-specification (DOCSIS) standard, which 
requires an approximately 43.75MHz IF frequency. The up-converters 106 convert IF signals 
received from the channel servers 104 to radio frequency signals (RF signals). The RF signals, 
which include frequency and bandwidth, are dependent on a desired channel and adopted 
5 standards. For example, under the current standard in the United States for a cable television 
channel 80, the RF signal has a frequency of approximately 559.25MHz and a bandwidth of 
approximately 6MHz. The outputs of the up-converters 106 are applied to the 
combiner/amplifier 108. The combiner/amplifier 108 amplifies, conditions, and combines the 
received RF signals then outputs the signals out to a transmission medium 110. 
10 [17.] In an exemplary embodiment, the central controlling server 102 includes a graphics 

user interface (not shown) to enable a service provider to schedule data delivery by a drag-and- 
Q drop operation. Further, the central controlling server 102 authenticates and controls the channel 
01 servers 104 to start or stop according to delivery matrices. In an exemplary embodiment, the 
% central controlling server 102 automatically selects a channel and calculates delivery matrices for 

1© transmitting data files in the selected channel. The central controlling server 102 provides 

03 

T offline addition, deletion, and update of data file information (e.g., duration, category, rating, 
!Z and/or brief description). Further, the central controlling server 102 controls the central storage 
M 5 103 by updating data files and databases stored therein. 

g [18.] In an exemplary embodiment, an existing cable television system 120 may continue 

it to feed signals into the combiner/amplifier 108 to provide non-DOD services to clients. Thus, 

the DOD system 100 in accordance with the invention does not disrupt present cable television 

services. 

[19.] FIG. IB illustrates another exemplary embodiment of the DOD system 100 in 
accordance with the invention. In addition to the elements illustrated in FIG. 1A, the DOD 

25 system 100 includes a switch matrix 112, a channel monitoring module 114, a set of back-up 
channel servers 11 6a- 11 6b, and a set of back-up up-converters 11 8a- 11 8b. In one embodiment, 
the switch matrix 112 is physically located between the up-converters 106 and the 
combiner/amplifier 108. The switch matrix 112 is controlled by the central controlling server 
102. The channel monitoring module 114 comprises a plurality of configured set-top boxes, 

30 which simulate potential clients, for monitoring the health of the DOD system 100. Monitoring 
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results are communicated by the channel monitoring module 1 14 to the central controlling server 
102. In case of a channel failure (i.e., a channel server failure, an up-converter failure, or a 
communication link failure), the central controlling server 102 through the switch matrix 112 
disengages the malfunctioning component and engages a healthy backup component 116 and/or 

5 1 1 8 to resume service. 

[20.] In an exemplary embodiment, data files being broadcasted from the DOD system 
100 are contained in motion pictures expert group (MPEG) files. Each MPEG file is 
dynamically divided into data blocks and sub-blocks mapping to a particular portion of a data 
file along a time axis. These data blocks and sub-blocks are sent during a pre-determined time in 

10 accordance with three-dimensional delivery matrices provided by the central controlling server 
102. A feedback channel is not necessary for the DOD system 100 to provide DOD services. 

Q However if a feedback channel is available, the feedback channel can be used for other 

yi purposes, such as billing or providing Internet services. 

% pi. j FIG. 2 illustrates an exemplary channel server 104 in accordance with an 

f| embodiment of the invention. The channel server 104 comprises a server controller 202, a CPU 
r 204, a QAM modulator 206, a local memory 208, and a network interface 210. The server 
K controller 202 controls the overall operation of the channel server 104 by instructing the CPU 
P 204 to divide data files into blocks (further into sub-blocks and data packets), select data blocks 
X for transmission in accordance with a delivery matrix provided by the central controlling server 
it) 102, encode selected data, compress encoded data, then deliver compressed data to the QAM 
modulator 206. The QAM modulator 206 receives data to be transmitted via a bus (i.e., PCI, 
CPU local bus) or Ethernet connections. In an exemplary embodiment, the QAM modulator 206 
may include a downstream QAM modulator, an upstream quadrature amplitude 
modulation/quadrature phase shift keying (QAM/QPSK) burst demodulator with forward error 
25 correction decoder, and/or an upstream tuner. The output of the QAM modulator 206 is an IF 
signals that can be applied directly to an up-converter 106. 

[22.] The network interface 210 connects the channel server 104 to other channel servers 
104 and to the central controlling server 102 to execute the scheduling and controlling 
instructions from the central controlling server 102, reporting status back to the central 
30 controlling server 102, and receiving data files from the central storage 103. Any data file 
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retrieved from the central storage 103 can be stored in the local memory 208 of the channel 
server 104 before the data file is processed in accordance with instructions from the server 
controller 202. In an exemplary embodiment, the channel server 104 may send one or more 
DOD data streams depending on the bandwidth of a cable channel (e.g., 6, 6.5, or 8MHz), QAM 
5 modulation (e.g., QAM 64 or QAM 256, and a compression standard/bit rate of the DOD data 
stream (i.e., MPEG-1 or MPEG-2). 

[23.] FIG. 3 illustrates a universal set-top box (STB) 300 in accordance with one 
embodiment of the invention. The STB 300 comprises a QAM demodulator 302, a CPU 304, a 
local memory 308, a buffer memory 310, a decoder 312 having video and audio decoding 
10 capabilities, a graphics overlay module 314, a user interface 318, a communications link 320, 
and a fast data bus 322 coupling these devices as illustrated. The CPU 302 controls overall 
S operation of the universal STB 300 in order to select data in response to a client's request, 
O decode selected data, decompress decoded data, re-assemble decoded data, store decoded data in 
JE the local memory 308 or the buffer memory 310, and deliver stored data to the decoder 312. In 
ijlj an exemplary embodiment, the local memory 308 comprises non-volatile memory (e.g., a hard 
W drive) and the buffer memory 3 1 0 comprises volatile memory. 

L [24.] In one embodiment, the QAM demodulator 302 comprises transmitter and receiver 

Ff modules and one or more of the following: privacy encryption/decryption module, forward error 
O correction decoder/encoder, tuner control, downstream and upstream processors, CPU and 
M memory interface circuits. The QAM demodulator 302 receives modulated IF signals, samples 

and demodulates the signals to restore data. 

[25.] In an exemplary embodiment, when access is granted, the decoder 312 decodes at 

least one data block to transform the data block into images displayable on an output screen. The 

decoder 312 supports commands from a subscribing client, such as play, stop, pause, step, 
25 rewind, forward, etc. The decoder 312 provides decoded data to an output device 324 for use by 

the client. The output device 324 may be any suitable device such as a television, computer, any 

appropriate display monitor, a VCR, or the like. 

[26.] The graphics overlay module 314 enhances displayed graphics quality by, for 

example, providing alpha blending or picture-in-picture capabilities. In an exemplary 
30 embodiment, the graphics overlay module 3 14 can be used for graphics acceleration during game 
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playing mode, for example, when the service provider provides games-on-demand services using 
the system in accordance with the invention. 

127.] The user interface 318 enables user control of the STB 300, and may be any suitable 
device such as a remote control device, a keyboard, a smartcard, etc. The communications link 
320 provides an additional communications connection. This may be coupled to another 
computer, or may be used to implement bi-directional communication. The data bus 322 is 
preferably a commercially available "fast" data bus suitable for performing data communications 
in a real time manner as required by the present invention. Suitable examples are USB, firewire, 
etc. 

[28.] In an exemplary embodiment, although data files are broadcast to all cable 
television subscribers, only the DOD subscriber who has a compatible STB 300 will be able to 
decode and enjoy data-on-demand services. In one exemplary embodiment, permission to obtain 
data files on demand can be obtained via a smart card system in the user interface 318. A smart 
card may be rechargeable at a local store or vending machine set up by a service provider. In 
another exemplary embodiment, a flat fee system provides a subscriber unlimited access to all 
available data files. 

[29.] In preferred embodiments, data-on-demand interactive features permits a client to 
select at any time an available data file. The amount of time between when a client presses a 
select button and the time the selected data file begins playing is referred to as a response time. 
As more resources are allocated (e.g., bandwidth, server capability) to provide DOD services, the 
response time gets shorter. In an exemplary embodiment, a response time can be determined 
based on an evaluation of resource allocation and desired quality of service. When combined 
with the embodiment of placing the first data block in a parallel stream, the response time 
becomes a factor only of the time it takes to receive and process that first data block. 

[30.] In one embodiment, the number of data blocks (NUM_OF_BLKS) for each data file 
can be calculated as follows: 

Estimated_BLK_Size = (DataFile Size * TS) / DataFile_Length (1 ) 

BLK SIZE = (Estimated BLK Size + CLUSTER SIZE - lByte) / CLUSTER _SIZE (2) 
BLK_SIZE_BYTES = BLK_SIZE * CLUSTER_SIZE (3) 

60595-300501 Page 10 

SV/224248.04 
60595.300501 



NUMOFBLKS =(DataFile_Size + BLK_SIZE_BYTES - lByte)/BLK_SIZE_BYTES (4) 



[31.] In equations (1) to (4), the Estimated_BLK_Size is an estimated block size (in 
Bytes); the DataFile_Size is the data file size (in Bytes); TS represents the duration of a time slot 
5 (in seconds); DataFile_Length is the duration of the data file (in seconds); BLK SIZE is the 
number of clusters needed for each data block; CLUSTER _SIZE is the size of a cluster in the 
local memory 208 for each channel server 104 (e.g., 64KBytes); BLK SIZE BYTES is a block 
size in Bytes. In this embodiment, the number of blocks (NUM OF BLKS) is equal to the data 
file size (in Bytes) plus a data block size in Bytes minus 1, Byte and divided by a data block size 
10 in Bytes. Equations (1) to (4) illustrate one specific embodiment. A person of skill in the art 
would recognize that other methods are available to calculate a number of data blocks for a data 
a file. For example, dividing a data file into a number of data blocks is primarily a function of an 
S estimated block size and the cluster size of the local memory 208 of a channel server 104. Thus, 
*P the invention should not be limited to the specific embodiment presented above. 
5 [32.] FIG. 4 illustrates an exemplary process for generating a scheduling matrix for sending 

141 a data file in accordance with an embodiment of the invention. In an exemplary embodiment, this 
M= invention uses time division multiplexing (TDM) and frequency division multiplexing (FDM) 
2 technology to compress and schedule data delivery at the server side. In an exemplary 
£ embodiment, a scheduling matrix is generated for each data file. In one embodiment, each data 
20 file is divided into a number of data blocks and the scheduling matrix is generated based on the 
number of data blocks. Typically, a scheduling matrix provides a send order for sending data 
blocks of a data file from a server to clients, such that the data blocks are accessible in sequential 
order by any client who wishes to access the data file at a random time. 

[33.] At step 402, a number of data blocks (x) for a data file is received. A first variable, 
25 j, is set to zero (step 404). A reference array is cleared (step 406). The reference array keeps 
track of data blocks for internal management purposes. Next, j is compared to x (step 408). If j is 
less than x, a second variable, i, is set to zero (step 412). Next, i is compared to x (step 414). If i 
is less than x, data blocks stored in the column [(i+j) modulo (x)] of a scheduling matrix are 
written into the reference array (step 418). If the reference array already has such data block(s), 
30 do not write a duplicate copy. Initially, since the scheduling matrix does not yet have entries, 
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this step can be skipped. Next, the reference array is checked if it contains data block i (step 
420). Initially, since all entries in the reference array have been cleared at step 406, there would 
be nothing in the reference array. If the reference array does not contain data block i, data block 
i is added into the scheduling matrix at matrix position [(i+j) modulo (x), j] and the reference 
array (step 422). After the data block i is added to the scheduling matrix and the reference array, 
i is incremented by 1, such that i = i + 1 (step 424), then the process repeats at step 414 until i = 
x. If the reference array contains data block i, i is incremented by 1, such that i = i + 1 (step 424), 
then the process repeats at step 414 until i = x. When i = x, j is incremented by 1, such that j = j + 
1 (step 416) and the process repeats at step 406 until j - x. The entire process ends when j = x 
(step 410). 

[34.] In an exemplary embodiment, if a data file is divided into six data blocks (x = 6), 
the scheduling matrix and the reference arrays are as follows: 



Scheduling Matrix (SM) 



TSO 


TS1 


TS2 


TS3 


TS4 


TS5 


[0, 0] blkO 


[1,0] blkl 


[2, 0] blk2 


[3, 0] blk3 


[4, 0] 
blk4 


[5, 0] blk5 


[0, 1] 


[1, 1] blkO 


[2, 1] 


[3, 1] 


[4, 1] 


[5,1] 


[0,2] 


[1,2] 


[2, 2] blkO 


[3, 2] blkl 


[4,2] 


[5,2] 


[0, 3] 


[1,3] 


[2,3] 


[3, 3] blkO 


[4,3] 


[5, 3] blk2 


[0,4] 


[l,4]blk3 


[2,4] 


[3,4] 


[4, 4] 
blkO 


[5, 5] blkl 


[0,5] 


[1,5] 


[2,5] 


[3, 5] blk4 


[4,5] 


[5, 5] blkO 



Reference Array (RA) 





spaceO 


spacel 


space2 


space3 


space4 


space5 


TSO 


blkO 


blkl 


blk2 


blk3 


blk4 


blk5 


TS1 


blkl 


blkO 


blk2 


blk3 


blk4 


blk5 


TS2 


blk2 


blkO 


blk3 


blkl 


blk4 


blk5 
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TS3 


blk3 


blkl 


blkO 


blk4 


blk5 


blk2 


TS4 


blk4 


blkO 


blk5 


blk2 


blkl 


blk3 


TS5 


blk5 


blk2 


blkl 


blkO 


blk3 


blk4 



[35.] Appendix A attached to this application describes a step-by-step process of the 
exemplary process illustrated in FIG. 4 to generate the above scheduling matrix and reference 
arrays. In this exemplary embodiment, based on the scheduling matrix above, the six data blocks 
of the data file are sent in the following sequence: 

TSO =>blkO 

TSI => blkO, blkl, blk3 

TS2 =>blk0,blk2 

TS3 => blkO, blkl, blk3,blk4 

TS4 =>blk0,blk4 

TS5 => blkO, blkl, blk2, blk5 
[36.1 In another exemplary embodiment, a look-ahead process can be used to calculate a 
look-ahead scheduling matrix to send a predetermined number of data blocks of a data file prior 
to a predicted access time. For example, if a predetermined look-ahead time is the duration of 
one time slot, for any time slot greater than or equal to time slot number four, data block 4 (blk4) 
of a data file should be received by a STB 300 at a subscribing client at or before TS3, but blk4 
would not be played until TS4. The process steps for generating a look-ahead scheduling matrix 
is substantially similar to the process steps described above for FIG. 4 except that the look-ahead 
scheduling matrix in this embodiment schedules an earlier sending sequence based on a look- 
ahead time. Assuming a data file is divided into six data blocks, an exemplary sending sequence 
based on a look-ahead scheduling matrix, having a look-ahead time of the duration of two time 
slots, can be represented as follows: 
TSO => blkO 

TSI => blkO, blkl, blk3, blk4 
TS2 => blkO, blk2 
TS3 => blkO, blkl, blk3, blk4, blk5 
TS4=>blkO, blk5 
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TS5=>blkO, blkl,blk2 
[37.] A three-dimensional delivery matrix for sending a set of data files is generated 
based on the scheduling matrices for each data file of the set of data files. In the three- 
dimensional delivery matrix, a third dimension containing IDs for each data file in the set of data 
5 files is generated. The three-dimensional delivery matrix is calculated to efficiently utilize 
available bandwidth in each channel to deliver multiple data streams. In an exemplary 
embodiment, a convolution method, which is well known in the art, is used to generate a three- 
dimensional delivery matrix to schedule an efficient delivery of a set of data files. For example, 
a convolution method may include the following policies: (1) the total number of data blocks 
1 0 sent in the duration of any time slot (TS) should be kept at a smallest possible number; and (2) if 
multiple partial solutions are available with respect to policy (1), the preferred solution is the one 
fa which has a smallest sum of data blocks by adding the data blocks to be sent during the duration 
m of any reference time slot, data blocks to be sent during the duration of a previous time slot (with 
£ respect to the reference time slot), and data blocks to be sent during the duration of a next time 
5 slot (with respect to the reference time slot). For example, assuming an exemplary system 
yJ sending two short data files, M and N, where each data file is divided into six data blocks, the 
t sending sequence based on a scheduling matrix is as follows: 
P TSO=>blkO 
2 TS 1 => blkO, blkl, blk3, blk4 

20 TS2 => blkO, blk2 



TS3 => blkO, blkl, blk3, blk4 
TS4 => blkO, blk4 



TS5=>blkO,blkl,blk2,blk5 
[38.] Applying the exemplary convolution method as described above, possible 
25 combinations of delivery matrices are as follows: 



Option 1 : Send video file N at shift 0 TS 



Total Data Blocks 



TS0=>M0, NO 

TS1 => M0,M1,M3,N0,NI,N3 



2 



6 
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TS2=>M0, M2,N0,N2 

TS3 => MO, Ml, M3, M4, NO, Nl , N3, N4 

TS4=>M0, M4,N0,N4 

TS5 => MO, MI, M2, M5, NO, NI, N2, N5 



4 

8 
4 
8 



Option 2: Send video file N at shift 1 TS 



Total Data Blocks 



TS0=>M0,N0,N1,N3 
TS1 => MO, MI, M3, NO, N2 
TS2 => MO, M2, NO, Nl, N3, N4 
TS3 =>MO, Ml, M3, M4, NO, N4 
TS4 => MO, M4, NO, Nl, N2, N5 
TS5 => MO, Ml, M2, M5, NO 



4 
5 
6 
6 
6 
5 



Option 3: Send video file N at shift 2 TS 



Total Data Blocks 



TS0=>M0,N0,N2 

TS1 => MO, Ml, M3, NO, Nl, N3, N4 

TS2=>M0, M2,N0,N4 

TS3 =>MO, Ml, M3, M4, NO, Nl, N2, N5 

TS4=>M0, M4,N0 

TS5 => MO, Ml, M2, M5, NO, Nl, N3 



3 
7 
4 
8 
3 
7 



Option 4: Send video file N at shift 3 TS 



Total Data Blocks 



TS0=>M0, NO, N1,N3,N4 
TS1 => MO, Ml, M3, NO, N4 
TS2 => MO, M2, NO, Nl, N2, N5 
TS3 =>M0, Ml, M3, M4, NO 
TS4=>M0, M4, N0,N1,N3 
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TS5 => MO, Ml, M2, M5, NO, Nl , N2 6 

Option 5 : Send video file N at shift 4 TS Total Data Blocks 

TSO =>M0,N0,N4 3 

TS1=>M0,M1,M3,N0,N1,N2,N5 7 

TS2 =>M0, M2, NO 3 

TS3=>M0,MI,M3,M4,N0,N1,N3 7 

TS4 => MO, M4, NO, N2 4 

TS5 =>MO, Ml, M2, MS, NO, Nl , N3, N4 8 

Option 6: Send video file N at shift 5 TS Total Data Blocks 

TSO =>M0, N0, _ Nl7N27N5 " "~5 

TS1 =>MO,Ml,M3,NO 4 

TS2 => MO, M2, NO, Nl , N3 5 

TS3 =>M0, Ml , M3, M4, NO, N2 6 

TS4 =>MO, M4, NO, Nl , N3, N4 6 

TS5 =>M0,M1,M2,M5,N0,N4 6 



[39.] Applying policy (1), options 2, 4, and 6 have the smallest maximum number of data 
blocks (i.e., 6 data blocks) sent during any time slot. Applying policy (2), the optimal delivery 
matrix in this exemplary embodiment is option 4 because option 4 has the smallest sum of data 
blocks of any reference time slot plus data blocks of neighboring time slots (i.e., 16 data blocks). 
Thus, optimally for this embodiment, the sending sequence of the data file N should be shifted 
by three time slots. In an exemplary embodiment, a three-dimensional delivery matrix is 
generated for each channel server 104. 

[40.] When data blocks for each data file are sent in accordance with a delivery matrix, a 
large number of subscribing clients can access the data file at a random time and the appropriate 
data blocks of the data file will be timely available to each subscribing client. In the example 
provided above, assume the duration of a time slot is equal to 5 seconds, the DOD system 100 
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sends data blocks for data files M and N in accordance with the optimal delivery matrix (i.e., 
shift delivery sequence of data file N by three time slots) in the following manner: 

Time 00:00:00=> MO NO Nl N3 N4 

Time 00:00:05=> MO Ml M3 NO N4 
5 Time 00:00: 1 0=> MO M2 NO Nl N2 N5 

Time 00:00: 15=> MO Ml M3 M4 NO 

Time 00:00:20=> MO M4 NO Nl N3 

Time 00:00:25=> MO Ml M2 M5 NO N2 

Time 00:00:30=> MO NO Nl N3 N4 
10 Time 00:00:35=> MO Ml M3 NO N4 

Time 00:00:40=> MO M2 NO Nl N2 N5 
b Time 00:00:45=> MO Ml M3 M4 NO 

H Time 00:00:50=> MO M4 NO Nl N3 

£ Time 00:00:55=> MO Ml M2 M5 NO N2 

£§ [41.] If at time 00:00:00 a client A selects movie M, the STB 300 at client A receives, 

7 stores, plays, and rejects data blocks as follows: 

fcof 

U Time 00:00:00=> Receive MO => play MO, store MO. 

S Time 00:00:05=> Receive Ml, M3 => play Ml, store MO, Ml, M3. 

20 Time 00:00: 10=> Receive M2 => play M2, store MO, Ml, M2, M3. 

Time 00:00: 1 5 => Receive M4 => play M3, store MO, Ml, M2, M3, M4. 

Time 00:00:20=> Receive none => play M4, store MO, Ml, M2, M3, M4. 

Time 00:00:25 => Recv M5 => play M5, store MO, Ml, M2, M3, M4, M5. 

25 [42.] If at time 00:00:10, a client B selects movie M, the STB 300 at client B receives, 

stores, plays, and rejects data blocks as follows: 

Time 00:00:10 =>RcvM0,M2 => play MO, store MO, M2. 

Time 00:00:15 => Rev Ml, M3, M4 => play Ml, store MO, Ml, M2, M3,M4. 

Time 00:00:20 => Rev none => play M2, store MO, Ml, M2, M3, M4. 

30 Time 00:00:25 => Rev M5 => play M3, store MO, Ml, M2, M3, M4, M5. 
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Time 00:00:30 => Rev none => play M4, store MO, Ml, M2, M3, M4, M5. 
Time 00:00:35 => Rev none => play M5, store MO, Ml, M2, M3, M4, M5. 



[43.] If at time 00:00:15, a client C selects movie N, the STB 300 of the client C receives, 
5 stores, plays, and rejects data blocks as follows: 

Time 00:00: 1 5 => Rev NO => play NO, store NO. 

Time 00:00:20=> Rev Nl N3 => play Nl, store NO, Nl, N3. 

Time 00:00:25=> Rev N2 => play N2, store NO, Nl, N2, N3. 

Time 00:00:30=> Rev N4 => play N3, store NO, Nl, N2, N3, N4. 

10 Time 00:00:35=> Rev none => play N4, store NO, N1,N2,N3,N4. 

Time 00:00:40=> Rev N5 => play N5, store NO, Nl , N2, N3, N4, N5. 

5 [44.] If at time 00:00:30, a client D also selects movie N, the STB 300 at the client D 

=p receives, stores, plays, and rejects data blocks as follows: 

j| Time 00:00:30 => Rev NO, Nl, N3, N4 => play NO, store NO, Nl, N3, N4. 

W Time 00:00:35=> Rev none => play Nl, store NO, Nl, N3, N4. 

H Time 00:00:40=> Rev N2, N5 => play N2, store NO, Nl, N2, N3, N4, N5. 

if Time 00:00:45=> Rev none => play N3, store NO, Nl, N2, N3, N4, N5. 

£ Time 00:00:50=> Rev none ==> play N4, store NO, Nl, N2, N3, N4, N5. 

|i Time 00:00:55=> Rev none => play N5, store NO, Nl, N2, N3, N4, N5. 

[45.] As shown in the above examples, any combination of clients can at a random time 
independently select and begin playing any data file provided by the service provider. The above 
denotation of "Receive" is slightly misleading as the system is always receiving a continuous 
25 stream of data blocks determined by the time slot, but at any given point, the receiving STB may 
only require certain data blocks, having already received and stored the other received data 
blocks. This need is referred to as "receive" above, but may be more accurately referred to as 
"non rejected." Therefore, "receive M4" could be termed "reject all but M4" and "receive none" 
could better be termed "reject all." 



60595-300501 Page 18 



SV/224248.04 
60595.300501 



[46.] What becomes apparent from the examples given above is that available bandwidth 
is not being fully used during certain time slots. In particular, during at least some time slots 
there is "idle time" wherein no transmission occurs. This idle time is an inherently ineffective 
use of available bandwidth. Let's take as an example option 4 shown above wherein two data 
blocks are transmitted during the respective time slot. In other words, in a time slot having 
bandwidth suitable for transmitting six data blocks, four data block transmission periods are left 
idle. Although this is not dramatic in option 4, it becomes more extreme as data files become 
thousands of data blocks big. Even using optimal combination protocols for combining data, 
there may still be significant sections of empty block space. 

[47.] This empty block space equates to bandwidth which is not being used, and therefore 
is wasted bandwidth. A goal of this invention is to decrease as much idle time as possible, and 
therefore one embodiment of the current invention is to perform another step after the scheduling 
matrix is determined, referred to herein as a decreased idle time scheduling matrix. 

[48.] An exemplary model of a decreased idle time scheduling matrixes can be explained 
with reference to the six block scheduling matrix described above, but repeated here for 
convenience. Idle time during which bandwidth could be utilized to transmit a data block is 
denoted "<-->" for clarity: 

TSO => blkO, <-->, <-->, <--> 

TS1 =>blk0,blkl,blk3,<--> 

TS2 => blkO, blk2, <-->, <--> 

TS3 => blkO, blkl, blk3, blk4 

TS4 => blkO, blk4, <-->, <--> 

TS5 => blkO, blkl, blk2,blk5 
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[49.] This is shown in graphical form in FIG. 5. The scheduling matrix clearly has 
unused bandwidth in the form of idle time during most time slots. The present invention teaches 
reduction of this idle time by utilizing constant bandwidth from time slot to time slot. The key to 
accomplishing decreased idle transmission time through constant bandwidth utilization is an 
5 understanding that the delivery sequence of the data blocks must be adhered to, while the exact 
time slot in which a data block is delivered is not relevant except that the data block must be 
received prior to or at the time in which it must be accessed. Accordingly, constant bandwidth 
utilization is accomplished by transmitting a constant number of data blocks within each time 
slot according to the delivery sequence set forth by the scheduling matrix and with disregard to 
1 0 the time slot assigned by the scheduling matrix. 

If [50.] In the six block scheduling matrix described above in detail, there is a significant 

5 amount of idle time in TSO, TS1, TS2 and TS4. For the sake of example, assume the desired 
% constant bandwidth corresponds to transmission of four data blocks per time slot. Accordingly, 
5 the idle time is decreased by moving forward data blocks until four data blocks are scheduled for 
£§ transmission during each time slot. The procedure for this is to take the next data block in 
f s sequence, and move it to the empty space. So for this example, the first block in TS1, blkO, is 
O moved to TSO. The next block in TS1, blkl, is also moved up. Then, since TSO still has an 
J empty data block space, blk3 from TS1 is also moved up. TSO then has all of its spaces filled, 
Tz and now looks like: 

20 

TSO => blkO, blkO, blkl, blk3 

[51.] Now TS1 and most of TS2 are empty, so the data blocks from TS3 get moved up. 
Once this sequence is finished, the matrix looks like: 

25 TSO => blkO, blkO, blkl , blk3 

TS 1 => blkO, blk2, blkO, blkl 
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TS2 



=>blk3,blk4, blk0,blk4 



TS3 => blkO, blkl, blk2,blk5 
TS4 => 
TS5 => 

[52.] This is also shown graphically in FIG. 6. Empty and incomplete time slots, such as 
TS4 and TS5 in this example, get filled up simply by repeating the original sequence, while still 
filling up the idle time. Hence the first six time slots would appear as: 

TSO => blkO, blkO, blkl, blk3 

TS1 => blkO, blk2, blkO, blkl 

TS2 => blk3, blk4, blkO, blk4 

TS3 => blkO, blkl, blk2,blk5 

TS4 => blkO, blkO, blkl , blk3 

TS5 => blkO, blk2, blkO, blkl 

[53,] The next two time slots in this sequence, TS6 and TS7, would have the same data 
blocks as TS2 and TS3. Therefore what is actually produced by this process in a new, shorter 
scheduling matrix, now only four time slots long. FIG. 7 graphically depicts this new repeating 
matrix created by filling up idle time. 

[54.] It is obvious from the example given above that as long as the original order is 
followed, a user can now receive the data file ahead of time in contrast with the on time delivery 
of the original scheduling matrix. A user may even enter the system mid-time slot and begin 
using the data as soon as a starting block, blkO, is received. 
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[55.] In this fashion, time slots become largely a computational fiction, as the data blocks 
become a continuous stream, and at any point in the stream a user may jump onto the system and 
begin receiving data. As can be seen in Fig. 8, this additional step is a relatively simple step 510, 
performed at what was the end of the procedure 410. 

5 [56.] For simplicity's sake, the above description of FIGS. 4-10 dealt with an instance 

where the selected bandwidth was set to a constant equal to an integer number of data blocks. 
However, the constant bandwidth need not be equal to an integer number of data blocks. 
Instead, what is simply required is that the delivery sequence adhere to the sequence developed 
as in FIG. 8. The data stream generated by the delivery sequence developed in FIG. 8 is then 
10 provided to a lower level hardware device (e.g., a network card or the channel server) which 
b controls broadcast of the digital data. Rather than broadcasting an integer number of data blocks, 
S the lower level hardware device will transmit as much data as possible within the bandwidth 
£ allocated to the file. 

5 [57.] As will be appreciated by those of skill in the art, at the abstraction level of the 

f 5 delivery sequence, one need not worry about the actual transmission of data. Instead, the 
Q delivery matrix provides the sequence and the lower level hardware device controls broadcast of 
J data utilizing the allocated bandwidth. Hence an allocated bandwidth which includes a fraction 
J 3 of a data block size can be fully utilized. Once the allocated bandwidth has been utilized, the 
lower level device will pause broadcast of this particular data file until bandwidth is again 
20 available. 

[58.] In the above example, the maximum bandwidth used in the original scheduling 
matrix is used in the decreased idle time matrix. This is so that, no matter at what point a user 
begins receiving data, the maximum wait time has not changed. However, as will be apparent to 
one of ordinary skill in the art, bandwidth may be adjusted to either the cost or benefit of time. It 
25 is important that for a data-on-demand service that the maximum time taken does not exceed the 
time it takes to execute the file. If this were to happen, the result would be a scheduling matrix 
with a total number of time slots greater than the number of time slots the original scheduling 
matrix contained. If this were a two hour movie, for example, it might take three hours to play, 
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leaving gaps in the middle of the movie. Some applications, however, might be able to use or 
even desire this function, such as streams of data that can be downloaded without being used 
immediately. 

[59.] Single streams of data which have a constant, fully optimized, bandwidth can 
5 simply be combined together. The result would be a multiple stream bandwidth, whose total 
width is the sum of the single streams. 

[60.] As shown, decreasing the idle time is very useful for calculating a scheduling matrix 
for a single stream of data. In this manner, an assigned amount of bandwidth may be fully used 
when transmitting a stream of data. As mentioned above, however, an aspect of the invention is 
» creating a three dimensional delivery matrix. With a three dimensional delivery matrix, a 
S decreased idle time delivery matrix may also be calculated and implemented in exactly the same 
4! fashion. However, once the use of the decreased idle time delivery matrix is used on a single 
O stream, and then multiple, fully optimized, single streams are combined together, this will likely 
p outperform the three dimensional matrix system in most circumstances. 

|jf [61.] So what is embodied is a computer implemented method for transmission of an on- 

U demand data file comprising an act of preparing a delivery matrix defining a repeating data 
M. transmission sequence suitable for broadcast over a medium to a plurality of clients in a non- 
specific manner. This act of preparing the delivery matrix further comprises reducing a data file 
into data blocks having at least a first block, and ordering the data blocks into a said repeating 
20 data transmission sequence. Therefore a user may receive the repeating data transmission 
sequence and begin using the data file in an uninterrupted manner as soon as the first block is 
received. This repeating data transmission sequence requires a pre-determined bandwidth, and 
further there is de-minimus idle time in transmission of the repeating data transmission sequence. 
Also transmission of the data on-demand file requires an amount of transmission bandwidth that 
25 is independent of the number of clients. 

[62.] FIG. 9 summarizes in flow chart form how a decreased idle time scheduling 
sequence is determined. First 520 an original scheduling matrix is generated for a data file. This 
original scheduling matrix is simply a non-decreased idle time scheduling matrix in accordance 
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with the present invention. It is referred to as "original" for clarity purposes. What becomes 
apparent about the original scheduling matrix is not the structured matrix itself, but the order in 
which the data blocks are derived. The order of the data blocks in the original matrix is therefore 
of primary importance in determining a decreased idle time scheduling matrix. The original 

5 matrix is therefore treated as a scheduling sequence 530. As shown above, this scheduling 
sequence can be used to fill in the idle time in the original matrix. However, at this point it 
might be desirable to first adjust the amount of bandwidth assigned to the data file 540. Once the 
bandwidth is assigned, data block are move "up" the matrix until all of the idle time slots are 
removed. Intellectually, if this is thought of as a sequence, the idle time slots are deleted 550. 
10 Once this is completed, the sequence from the original scheduling matrix is repeated. What will 
end up happening is that there will be a new repeating sequence, and this can be thought of as a 

^ new decreased idle time scheduling matrix 560. 

O [63.] It is worth noting that the difference between a scheduling sequence and decreased 

£ idle time scheduling matrix is mainly cognitive. One can be depicted as a linear sequence and 
ljjSf the other as a repeating matrix, but the net result is that a user receives a constant stream of non 
S client specific blocks of data. 

S [64.] A method for further reducing the bandwidth necessary for broadcasting scheduling 

?t matrices of DOD data blocks is to broadcast frequently occurring data blocks on a dedicated 
O channel. As can be seen from the exemplary matrices below selected data blocks occur more 
iO frequently than other data blocks within the stream. The original delivery matrix with idle time 
appeared as follows: 

TS0 => blkO, <-->, <-->, <--> 

TS 1 => blkO, blkl , blk3, <--> 

TS2 => blkO, blk2, <-->, <-> 

25 TS3 => blkO, blkl , blk3, blk4 

TS4 => blkO, blk4, <-->, <--> 
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TS5 => blkO, blkl, blk2,blk5 



The delivery matrix with decreased idle time created by the process of FIG. 9 appears as follows: 
TSO => blkO, blkO, blkl, blk3 
TS1 => blkO, blk2, blkO, blkl 
TS2 => blk3, blk4, blkO, blk4 
TS3 => blk0 5 blkl, blk2, blk5 

The exemplary decreased idle time matrix represented as a linear repeating stream of data would 
appear as the following: 

streamO=> blkO, blkO, blkl, blk3, blkO, blk2, blkO, blkl, blk3, blk4, blkO, blk4, blkO, blkl, blk2, 
blk5 

[65.] As can be seen from a linear representation of the exemplary delivery matrix, blkO is 
transmitted more frequently than blocks 1-5. Different delivery matrices may result in a 
different data blocks occurring more or less frequently within a given stream of data blocks. In 
any delivery matrix data blocks occurring earlier in the sequence will occur more frequently, 
with block 0 always occurring most frequently. 

[66.] Because blkO occurs in the data stream more frequently than other data blocks, a 
narrower transmission bandwidth can be achieved by sending blkO and other frequently 
occurring blocks in an independent data stream. This stream could have a greatly decreased 
bandwidth over the original stream, and the bandwidth assigned to the original stream could also 
be decreased by transmitting only the less frequent data blocks. For example, if the above stream 
were broken into two separate streams, a prefetch stream carrying only data blkO and a primary 
stream carrying the remaining data blocks, the two repeating streams would appear as follows: 

primary stream=> blkl , blk3, blk2, blkl , blk3, blk4, blk4, blkl, blk2, blk5 

prefetch stream=> blkO 
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[67.] Thus by transmitting blkO in an independent data stream, the bandwidth required to 
transmit the primary data stream is reduced by 37.5 %. This reduction is due to BlkO comprising 
6 of 16 total data blocks in the primary data stream, such that removal of BlkO effectively 
reduces the number of data blocks transmitted in the primary data stream by 6. The additional 
5 bandwidth required to transmit the prefetch data stream containing BlkO is small in comparison, 
being dependent on the amount of buffering performed by a receiving STB. This buffering will 
be discussed in more detail with respect to FIG. 12 below. 

[68.] A significant advantage to this method of transmission is decreased time required to 
access a selected data-on-demand service. As soon as blkO of a selected DOD service is received 
10 a user may begin using the selected service, whereas without the prefetch stream a user would 
u have to wait until blkO occurred in the primary data stream. Because blkO is transmitted 
2 continuously over an independent stream, a service may be used without waiting for the next 
U1 blkO to be received from a stream containing many different data blocks. Of course, in order to 
O have fluid use of the data-on-demand system, blkl has to be received and ready for use by the 
£j time blkO is finished, this requires that the primary data stream has a large enough bandwidth to 
s assure that blkl is received before blkO has concluded. 

[69.] FIG. 10 illustrates a process at 600 for scheduling DOD data blocks for transmission 
*Q on a primary data stream and a prefetch data stream in accordance with one embodiment of the 
U present invention. At a first step 602 a decreased idle time schedule is represented as a linear 
20 sequence of data blocks arranged in the order the data blocks would be transmitted. At a step 
604, the most frequently occurring data block is removed from the sequence leaving a shorter 
sequence of data blocks requiring a much narrower bandwidth. As discussed above, BlkO always 
occurs most frequently. At a step 606 the data block removed from the decreased idle time 
sequence is placed in a prefetch data stream comprised entirely of BlkO data blocks. Then in a 
25 step 608 the shortened sequence of data blocks is placed in a primary data stream. Then in a step 
610 the primary data stream and the prefetch data stream are transmitted as two separate 
repeating data streams on separate bandwidths to receiving set-top-boxes via the transmission 
medium 110 (FIG. IB). 
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[70.]FIG. 1 1 illustrates a process at 650 for scheduling DOD data blocks for transmission 
on a primary data stream and a prefetch data stream in accordance with one embodiment, 
wherein multiple DOD data blocks from a DOD delivery matrix are transmitted on a prefetch 
data stream thereby minimizing the total necessary transmission bandwidth. At a first step 652 a 
decreased idle time schedule is represented as a linear sequence of data blocks arranged in the 
order the data blocks would be transmitted. At a step 654, the most frequently occurring data 
block is removed from the sequence leaving a shorter primary sequence of data blocks requiring 
a much narrower bandwidth. At a step 656 the data block removed from the decreased idle time 
sequence is placed in a prefetch data stream. 

[71.]In step 658 a determination is made as to whether the bandwidth required transmit 
the shorter primary stream of data blocks has been reduced below a predetermined threshold 
value. This step may require many complex subprocesses that would be apparent to one skilled 
in the art. If the bandwidth requried for the primary data stream is below the threshold, then the 
process continues to step 660. At step 660 the primary data stream and the prefetch data stream 
are transmitted as two separate repeating data streams on separate bandwidths to receiving set- 
top-boxes via the transmission medium 1 10 (FIG. IB). 

[72.]If the required bandwidth is above the threshold value then the process returns to 
step 654, wherein the data block occurring with the greatest frequency of the remaining data 
blocks is removed. Then in step 656 the removed data block is added to the prefetch data stream. 
The process continues to repeat itself until the required transmission bandwidth is determined to 
be below the threshold value in step 658, at which time the process concludes at step 660. In 
alternative embodiments other criteria may be used instead of a threshold value, such as 
minimizing the combined bandwidth requirement for both the primary and prefetch data streams. 
In this manner the bandwidth required to transmit DOD services is further reduced over the 
decreased idle time and constant bandwidth delivery method of Khoi Hoang's parent application 
entitled Decreased Idle Time And Constant Bandwidth Data-On-Demand Broadcast 
Delivery Matrices, filed June 25, 2001, bearing application No. 09/892,017. 
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[73.]Removing frequently occurring data blocks from the primary data stream has the 
effect of greatly reducing the total number of data blocks contained in the primary data stream, 
thereby reducing the bandwidth required for transmitting the primary data stream. The table 
below describes the sample bandwidth savings for the removal of selected data blocks from the 
5 primary data stream: 

TABLE 1: Bandwidth savings for particular pre-loading data blocks in a six block sequence: 





DATA BLOCK 
(PRELOADED) 


Estimated 
Frequency oi 
Occurrence in data 
block (in a 6 block 
sequence) 


Estimated ! 
Bandwidth savings 




BlkO 


100% 


1 BW 




Blkl 


~ 50% 


-.5 BW 




Blk2 


~ 33% 


~ .33BW 




Blk3 


~ 25% 


~ .25BW 




Blk4 


~ 20% 


~ .20BW 




Blk5 


~ 16% 


~.16BW 



P [74.] In order to have immediate access to a DOD service transmitted by the above 

method, a receiving STB must pre-load and store some or all of the data contained in the prefetch 
data stream. Because the STB must first load and store a blkO of any DOD service it is to 

10 display, there is a tradeoff between the transmission bandwidth saved and an accessing delay 
time. By pre-loading the prefetch data stream and storing the prefetch data blocks a client STB 
may access a selected DOD service with minimal delay. This requires a receiving STB to have a 
memory sufficient to store the data contained in the prefetch data stream. 

[75.] FIG. 12 illustrates a set-top-box pre-loading process at 700 in accordance with one 
15 embodiment of the present invention. In step 702, the set top box is set to an idle or passive 
mode. Typically this mode would be a default mode for all client set-top-boxes. In step 704, the 
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set-top-box receives the prefetch data stream on a dedicated channel. In an exemplary 
embodiment the prefetch data stream is received on the electronic programming guide channel. 
In step 706 the set top box determines whether the prefetch data blocks received are more recent 
than prefetch data that had been stored earlier. An identifier contained within each prefetch data 
block indicates to the set top box how recent a data block is. If the data blocks received are more 
recent the set top box stores the latest prefetch data blocks in an internal memory 308 (FIG. 3) in 
step 708, typically a hard disk drive magnetic storage device. Typically earlier data blocks are 
overwritten with more recent prefetch data blocks, though older versions may be retained for 
various reasons. 

[76.] In step 710 the set top box is switched to active mode either by a timer, or by user 
command. In an exemplary embodiment the set top box automatically switches to active mode 
whenever any user command is received by the set top box. In such an embodiment the set top 
box would remain in the active mode for some time period, after which it would return to a 
passive mode. 

[77.]In step 712 the set top box receives a command to play a selected DOD service. 
This may be accomplished by a user entering a code corresponding to the selected DOD service 
or by selecting the DOD service from a menu within the electronic program guide service. In 
step 714 the set top box plays the first data block (blkO) of the selected DOD service from the 
prefetch data blocks stored in step 708. In step 716 the set top box tunes into the appropriate 
channel and receives and stores in memory 308 (FIG. 3) the primary data stream corresponding 
to the selected DOD service. In an exemplary embodiment this step occurs in parallel with step 
714 until the user stops playing the selected DOD service. 

[78.] In step 718, if all prefetch data blocks corresponding to the selected DOD service 
have been played the process continues to step 720. In step 720 the remainder of the DOD 
service is played from the primary stream data blocks previously received in step 716. This 
allows the first data block (blkO), or the first few data blocks of a DOD service to be played from 
the stored prefetch data blocks while the primary stream of data blocks corresponding to the 
selected DOD service are downloaded from a server. Such a system allows seamless viewing of 
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DOD services with minimal delay in access time and reduced bandwidth requirements. For 
optimal function, sufficient prefetch data blocks must be stored and played to allow data blocks 
from the primary data stream to download in time for use. This could require increases in either 
the bandwidth of the prefetch stream or in the primary data stream. 

[79.] The data configured into the prefetch data stream and eventually loaded into the idle 
set top box through the prefetch stream may change over the course of the day, week, or month 
to reflect preferences of users and create a maximum of bandwidth savings. For example, on a 
Monday night in the autumn, a particular sporting event may be made more prevalent in the 
prefetch data stream as opposed to a weekend night, when the newest family feature movie 
released has the beginning sequence sent in the prefetch data stream. 

[80.] The set top box user can start the desired programming at any time without delay 
because of the preloaded data block sequence already stored on the STB while the box was in 
idle mode. This pre-fetch data block sequence can be continually updated while the STB is idle 
mode to reflect pre-programmed changes made by the user (such as an order for a movie that the 
user has not started watching) or by a preset sequence update based on anticipated DOD user 
requests. 

[81.] The foregoing examples illustrate certain exemplary embodiments of the invention 
from which other embodiments, variations, and modifications will be apparent to those skilled in 
the art. The invention should therefore not be limited to the particular embodiments discussed 
above, but rather is defined by the following claims. 

[82.] What is claimed is: 
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